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CLAIMS 



[Claim(s)] 

[Claim 1] (a) While detecting the binary image in which the edge location which is the boundary 
of reception and this image data to a pixel value change about the image data of two- 
dimensional size is shown The 1st [ which corresponds the 1st edge positional information which 
shows the direction component of said edge location from this binary image ] detection means 
which detects for every pixel, (b) The 2nd detection means which detects the 2nd edge 
positional information which reception and a direction component carry out grouping of said 1st 
edge positional information relevant to mutual for said 1st edge positional information, and shows 
the edge location by which grouping was carried out (c) A means to ask for the transition 
location of a pixel value by referring to each pixel value in said image data area corresponding to 
reception and said 2nd edge positional information for said 2nd edge positional information, (d) 
Image processing system which has a coding means to encode the difference of the edge 
location specified to said 2nd edge positional information and said 2nd edge positional 
information, and said transition location. 

[Claim 2] The image processing system characterized by including the geometric information 
which shows the die length of the edge by which grouping was carried out to said 2nd edge 
positional information, a direction, and a starting position in the 1 st term of a claim. 
[Claim 3] A means to ask for the transition location of said pixel value in the 1 st term of a claim 
is an image processing system characterized by being carried out by comparing the average of 
each pixel value and each pixel value in said image data area. 

[Claim 4] (a) A detection means to detect the edge positional information which shows the edge 
location which is the boundary of reception and this image data to a pixel value about the image 
data of two-dimensional size, (b) A coding means to encode said edge positional information, and 
an image reconstruction means to perform image reconstruction based on the edge positional 
information by which (c) coding was carried out (d) — the difference of said image data and the 
playback image data reproduced by said playback means — a means to encode a value, the 
image based on (e) edge positional information, and difference — the image processing system 
[claim 5] which has the means which raises image quality gradually by carrying out sequential 
transmission of the value nonlinear sampling said whose coding means used edge positional 
information in the 4th term of a claim — said difference — the image processing system 
characterized by including a means to encode a value. 

[Claim 6] (a) Detect the binary image in which the edge location which is the boundary of 
reception and this image data to a pixel value change about the image data of two-dimensional 
size is shown, (b) The 1st edge positional information which shows the direction component of 
said edge location from said binary image is detected for every corresponding pixel, (c) 
Reception and a direction component carry out grouping of said 1st edge positional information 
relevant to mutual for said 1st edge positional information. The 2nd edge positional information 
which shows the edge location by which grouping was carried out is detected, (d) It asks for the 
transition location of a pixel value by referring to each pixel value in said image data area 
corresponding to reception and said 2nd edge positional information for said 2nd edge positional 
information. Edge positional information of the (e) above 2nd, The image-processing approach of 
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having the step which encodes the difference of the edge location specified to said 2nd edge 
positional information, and said transition location. 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Description of the Prior Art] In order that International Organization for Standardization (ISO) 
might answer the need for the general approach of encoding an animation by the low bit rate and 
might build the video coding standard about various applications, such as a video telephone and 
mobile communications, it formed MPEG-4 (Moving Pictures Expert Group, Phase 4) in 1993. 
The main purposes of many picture compression encoding methods tend to perform high 
playback of the fidelity about a subject-copy image with high-pressure shrinking percentage as 
much as possible. The criteria of fidelity of being used for the design of the compression 
encoding method play a big role on the engine performance. The criteria of fidelity of generally 
being used are an average square error (MSE). The main special features of MSE are that the 
mathematical count is easy and that the small value of MSE actually corresponds to the 
playback image of high quality sensuously. Since a final judgment of the reproduced image is 
made by human beings eyes, the latter is important 

[0002] The various image coding techniques of having MSE as criteria of fidelity, such as 
conversion coding, have been developed. Although these techniques bring about a comparatively 
quality playback image by the bit rate beyond a pixel, 1.0 bits /, and it, they are one of these and 
produce often more special visible degradation, for example, block distortion, edge dotage, etc. in 
a low bit rate. The new class of the image encoding method well learned as a second generation 
coding technique has been developed over the past ten years or more. These approaches tend 
to prove upgrading of the technique of MSE orientation [ bit rate / low-speed ] very much, and 
tend to draw an image by expressing a true stereo like a border line or texture in a compact 
further. So, the second generation encoding method is expected to attain high-pressure 
shrinking percentage on the criteria of the fidelity to which human being's eye which is not yet 
realized pointed 

[0003] Image coding based on sketch drawing is considered as a typical means of this category, 
and has been quoted as reference. This approach characterizes according to a profile line- 
extraction process, and results in bringing about a harmful distortion in sketch drawing playback 
to a local noise, by detection of a pixel unit since it is brittle. 
[0004] 

[Problem(s) to be Solved by the Invention] Moreover, a subject-copy image is conventionally 
disassembled into two components in addition to above-mentioned technique, and the technique 
of encoding those components is known. This technique disassembles a subject-copy image into 
a primary component (primary component) including edge information, and the loose smooth 
component (secondary component) of brightness change. The idea of decomposition coding was 
produced from 2 component model by John (Yan) and SAKURISON (Sakrison), and some 
practical approaches have been studied since then. 

[0005] All the approaches by these decomposition coding have the impact for the image quality 
of a playback image, as a result the whole engine performance with this big focusing on an edge 
extract, i.e., detection, an expression, and coding. Chain coding is used for a great portion of 
technique, in order to perform edge detection of a pixel unit like a peak point trace, i.e., an edge 



trace, and to encode the sequence of an edge location. However, it is pointed out that the 
problem of a closed curve and dealing with a local noise are difficult and, as for the above- 
mentioned technique, cause the result of interruption of an edge, a location error, and inaccurate 
reinforcement. Moreover, since it was thought that the information on a context exists only in 
the field restricted very much, there was no method of distinguishing the border line 
corresponding to an objective boundary and the border line which is not so. 
[0006] The purpose of this invention solves the technical problem of the above-mentioned 
conventional technique, and offers the image processing system which can acquire edge 
positional information from image data, and its approach by hierarchical edge detection. Other 
purposes of this invention offer the image of high quality while they introduce each step of 
hierarchical edge detection, i.e.. unit edge detection, macro edge detection, and local adjustment 
MENTO and express edge information In a compact 

[0007] Other purposes of this invention offer the image processing system which fidelity is 
excellent in in coding of image data, and encodes the image data based on high-pressure 
shrinking percentage, and its approach. Other purposes of this invention decompose image data 
into primary image components and secondary image components, and offer the image 
processing system which can reproduce the primary image by which edge orientation was carried 
out from primary image components, and its approach. 
[0008] 

[Means for Solving the Problem] It has the following means, in order to solve the above- 
mentioned technical problem. While the image processing system concerning invention of the 1 st 
of this application detects the binary image in which the edge location which is the boundary of 
reception and this image data to a pixel value change about the image data of two-dimensional 
size is shown The 1st [ which corresponds the 1st edge positional information which shows the 
direction component of said edge location from this binary image ] detection means which 
detects for every pixel, The 2nd detection means which detects the 2nd edge positional 
information which reception and a direction component carry out grouping of said 1 st edge 
positional information relevant to mutual for said 1st edge positional information, and shows the 
edge location by which grouping was carried out, A means to ask for the transition location of a 
pixel value by referring to each pixel value in said image data area corresponding to reception 
and said 2nd edge positional information for said 2nd edge positional information. It has a coding 
means to encode the difference of the edge location specified to said 2nd edge positional 
information and said 2nd edge positional information, and said transition location. 
[0009] Moreover, a detection means to detect the edge positional information the image 
processing system concerning the 2nd invention indicates the edge location which is the 
boundary of reception and this image data to a pixel value about the image data of two- 
dimensional size to be, A coding means to encode said edge positional information, and an image 
reconstruction means to perform image reconstruction based on the encoded edge positional 
information, the difference of said image data and the playback image data reproduced by said 
playback means — a means to encode a value, the image based on edge positional information, 
and difference — it has the means and « which raise image quality gradually by carrying out 
sequential transmission of the value. Since the application by this invention is a thing relevant to 
MPEG-4 area, the video telephone which deals with several sorts of bodies, and its pocket 
communication link are desirable as target application. The test sequence of a bust is used for 
simulation by such intention. 
[0010] 

[Function] According to this invention, by having used hierarchical edge detection (the unit edge 
detection shown in an example, macro edge detection, and step of local adjustment MENTO), the 
coding technique of edge contrast directivity can be offered and coding processing of the 
outstanding image data can be performed in consideration of the moral vision property of human 
being's vision system. 
[0011] 

[Example] Hereafter, the example of the image processing system of this invention is explained 
to a detail with reference to a drawing. Drawing 1 is the block diagram showing the configuration 
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of decomposition coding concerning the image processing system of this example. As shown in 
this drawing, a subject-copy image is supplied to the edge extract section 10. and the edge 
information about the border line of the body in an image etc. Is extracted here. The extracted 
edge information is supplied to the data optimization section 12, and in order to attain high^ 
pressure shrinkage, edge information-redundancy nature is removed. In this way, the primary 
component (primary component) 14 about the edge information extracted from the subject^copy 
image is obtained. 

[0012] Moreover, the primary component 14 is supplied to the image reconstruction section 16, 
and the primary image 1 8 is reproduced based on a primary component, and the reproduced 
primary image 18 — difference — a subject-copy image and difference ask in a vessel 20 — 
having — this difference — a value is supplied to the differential-encoding section 22. here — 
difference — DOT processing by the adjustable size block is performed about a value, and the 
encoded smooth component (secondary component) 24 is obtained. Drawing 2 is drawing 
showing the hierarchization edge extract process in the edge extract section of drawing 1 . The 
process of the edge extract from a subject-copy image is performed through each of the 
Laplacian filter 100, the unit edge detecting element 102, the macro edge detecting element 104, 
the local adjustment MENTO section 106, and the on-the-strength count section 108, 
[0013] First, as a subject-copy image, the image data (brightness component) of 480#704-pixel 
size is supplied to the Laplacian filter 100, and well-known Laplacian processing is performed. 
That is, secondary differential data in which the change about each pixel is shown are called for. 
In addition, the image data of a color difference component is the size sampled by on© half in 
480*704, and these data are used in the on-the-strength count section 108 mentioned later. 
Next the data by which Laplacian processing was carried out are supplied to the unit edge 
detecting element 102, and the binary image in which an exact edge location is shown is obtained 
by using mu+K-sigma for a threshold. Here, mu, sigma, and K are an average, the standard 
deviation of derivative space, and a multiplier, respectively. The concept of an edge location is 
used as a thing showing the boundary of the change, when the brightness of each pixel in image 
data changes steeply and continuously. 

[0014] And it matches about the pixel which shows the edge location in a subject-copy image 
using the segment pattern in which eight directions as shown in drawing 3 are shown. The 
pattern for matching is shown by Template Tn (n= 0, 1, .. 7), and each entry in (j» k) is expressed 
by tn (j, k). the sub field which consists lambda (x y) of 5#5pixellambda (x+j* y+k) — it is — 
making (j. k= 0, 1, 2, 3, 4) . The cross-correlation CRn (x y) between Tn and lambda (x y) is 
calculated by the degree type. 
[Equation 1] 

4 4 

CRn (x. y) = £ Stn (j, k) XA (x+j, y + k) »-(!) 

j=0 k=0 

[001 5] Therefore, CRn (x y) is equal to 7, or if n which is seven or more exists, a flag will stand 
on the coordinate (x y) of n bit plane. This shows that it was chosen as a matching pattern which 
Template Tn is a coordinate (x y) and calls a unit edge. For example, in matching about the pixel 
which shows a certain edge location, the pixel concerned used as a processing object is located 
at the core (location of threonine three trains) of a template, and if the neighboring pixel of the 
pixel concerned is located horizontally, template T four will be chosen, and the edge location 
which is the pixel concerned is processed as a thing with the direction component of T four. In 
addition, among drawing, the numeric value of "1" and "2" shows weighting of matching, and "2" 
is processing it as a thing heavier than "V by this example. 

[0016] Next, grouping, i.e., macro-izing. is performed by the macro edge detecting element 104 
about the pixel by which the unit edge was detected. As mentioned above, although a unit edge 
is prescribed by the template of eight directions, it is connected to the macro edge on which 
each of these unit edges are specified in the 16 directions in a continuous phase. 
[0017] If the pixel concerned which should be processed shall be located in one line, five trains, 
and (1, 5) supposing the pixel matrix of five line #9 train, the direction of 16 specified on a macro 
edge the location of (5, 5) of right under [ the ] — direction "0" — carrying out — and order — 



(6, 4), and „. (5 3) (5 1) — respectively — a direction — T and "2 "and" 4" — carrying out — 
moreover, order — (4. 1), (3, 1), and (2, 1) — respectively — a direction — it is referred to as "5 
"and" 7." the same — the order from direction "0" — right-hand side — (5. 6), and ... (5 7) (5 9) 
— respectively — a direction — "15" and "14 "and" 12" — carrying out — moreover, order — 
(4, 9X(3,_9). (2. 9), and (1, 9) — respectively — a direction — it is referred to as "11" and "10 
"and" 8." The direction n of a unit edge corresponds to N specified at a ceremony (2), and N is 
the core of the direction of a base that search processing for connection is performed. 
[Equation 2] N= 2n ... (2) 

[0018] The direction of the connection in a macro edge must be detected out of the direction of 
three candidates, i.e., N, N-1, and N+1. For example, rf a certain unit edge is a template T1, the 
unrt edge which is N= 2, therefore should be connected from the direction of 1, 2, and 3 will be 
detected. A unit edge must be connected in the direction which can extract a macro edge with 
the longest criteria of selection. In the direction of each candidate, it is determined in each node 
segmented by the unit length Lunrt (4 pixels is said) whether a macro edge is connected. If the 
flag of the bit side n. n-1, and n+1 arises near a node, a macro edge will be extended till a node. 
It is dependent on what is carried out what magnitude of a field counts for such decision. In 
addition, the unit edge of the pixel which will be located on the macro edge is eliminated after 
connection processing termination of a macro edge. 

[0019] Here, with reference to drawing 4 and drawing 5 , the concrete example of macro edge 
detection is explained. A macro edge is detected by connecting a unit edge in the following 
procedures. First the unit edge developed on n-bit plane is considered to be seemingly 
developed by N-bit plane so that it may correspond to (2) types. Supposing the flag stands on 
N-bit plane now, it will consider as the starting point lambda of the macro edge which detects 
the location after this. It is node piN and L about the point searched in case L unit edges are 
connected in the direction N from the starting point lambda. A definition is given and it is lambda 
in Lunrt=4. piN, and L Physical relationship is shown in drawing 4 . At this example, it is piN and 
L about a search aperture. It will consider as the 3x3~pixel field made into a core, and if the flag 
stands on this field on N, N-1, and an N+1-bit plane, sequential increment of the number L of 
connection is carried out, a search will be repeated and the node of the last whose connection 
was completed will be made into the terminal point of the candidate macro edge of Direction N. 
The candidate macro edge of a direction N-1 and a direction N+1 is also detected from the same 
starting point (if the flag stands into the search aperture on N-2 or N-bit plane by the search of 
a direction N-1 in these cases, it will be judged as connection), and, finally the number L of 
connection detects the greatest thing as a macro edge in these 3 candidate. Supposing two or 
more candidates with the maximum number L of connection exist, this number will choose the 
larger one, using the total of the flag in a search aperture as secondary scale. Next, the example 
of connection of a unit edge is shown in drawing 5 . The minimum field divided by the ruled line is 
a pixel, and each block diagram expresses the same subregfon on an image. Let the first location 
scans N bit plane and the flag stands be the starting point lambda of a macro edge. In this 
example, lambda is called for on 2-bit plane. Therefore, the search for connection will search a 
direction 3 by the search of a direction 1, and 2-bit plane by 0-bit plane at the search of 
directions 1, 2, and 3, and 4-bit plane. piN in case the number L of connection becomes max in 
the search of directions 1, 2, and 3, respectively, and L A location is shown In the lower berth of 
drawing 5 . Finally at this example, it is pi 1 and 3. It becomes the terminal point of the macro 
edge to detect 

[0020] In this way. detection of the macro edge about each unit edge is performed, and the 
starting position of the macro edge by which grouping was carried out, the direction of either of 
16. and die length are obtained Next in the local actfustment MENTO section 106, the rectangle 
field which wraps a macro edge in predetermined die-length Lext (this example 7 pixels) is 
specified as an edge belt E using the called-for macro edge. Drawing 6 is the example of a belt 
edge and sets a shaft perpendicular to a shaft parallel to a macro edge to p and q, respectively. 
And the pixel value on the edge belt E is expressed as epsilon (x y). 

[0021] Generally, an actual edge can be assumed to be what exists along with the macro edge of 
the edge belt E. In order to locate an actual edge correctly, change (8-bit gradation) of the gray 



level of a pixel is inspected in accordance with the shaft q perpendicular to a macro edge. The 
step is explained. 

(i) The average phi of the gray level of all the pixels in an edge belt is calculated first 

(ii) If it is smaller than the average psi. 0 is marked on the pixel corresponding to epsilon (x y). 
and if the gray level of each pixel is larger than the average psi, it will mark 1 about each pixel of 
the edge belt E. 

(iii) An actual edge is located to the place which the transition to 0 to 1, or 1-0 produces 
(default"0' r which expresses the pixel which does not produce such transition about the shaft on 
a macro edge is used)* 

(iv) By calculating respectively the average value about the pixel marked by the both sides of 0 
and 1, the edge profile which has an ideal step function is approximated, and it is the 
reinforcement delta 0 of the lower one. Reinforcement delta 1 of the higher one It obtains, 
respectively. 

[Equation 3] 

<5o =— 2 S £ Cp, q) -(3) 
r # (&q) <* 

1 

[0022] Here, it is tau 0. tau 1 The number of pixels with which are satisfied of the monograph 
affair of a sum total type (3) and (4) is shown. Drawing 7 shows the example of tic [ SUKEMA ] 
acquired by the local adjustment MENTO section 106. An actual edge location ts pursued by the 
thick wire. Moreover, the sequence of the pixel of a shaft q= 0 corresponds to a macro edge. In 
addition, the on-the-strength count section 108 performs count of the above-mentioned sum 
total type (3) and (4) based on the result of the local actfustment MENTO section 106. Moreover, 
the on-the-strength count section 108 performs count on the strength with the same said of a 
color difference component. 

[0023] The edge data obtained according to the above process are outputted to the data 
optimization section 12 from the edge extract section 10 shown in drawing 1 . In order to attain 
high-pressure shrinking percentage, the data optimization section 12 is removed from the edge 
data from which redundancy and the information which is not not much important were 
extracted, and encodes edge data. 

(i) Since the actual edge obtained by the local adjustment MENTOROKARUAJASUTOMENTO 
section 106 has the low pass property which met in the direction of a macro edge as shown in 
above-mentioned drawing 7 , by carrying out subsampling in the predetermined period Lsub, it 
reduces data and performs differential encoding about the reduced data. 

(ii) — reinforcement and Weber FEFUNA — with reference to a brightness difference threshold, 

this removes the edge which is not not much important in human being's vision sensibility using 

law. Let deltal be the brightness difference threshold of an illuminance I. deltal is prescribed that 

brightness becomes remarkable, when a brightness difference reaches deltal or it is exceeded. 

[Equation 4] 
AI 

— - =0 -<5) 

[0024] The above-mentioned formula can be expressed with a multiplier zeta, being able to 

assume that it is what deltal/I gives the magnitude of the vision sensibility E well. 

[Equation 5] 
A J 

AE=C — — (6) 

* 

It integrates with this and is [Equation 6]. E=zeta'logI ... (7) 

In order to apply the Weber FEFUNA method to the encoding method, a formula (5) is 



transformed using an original definition. That is. the macro edge with which are satisfied of a 
bottom type is removed from the data of a primary component 
[Equation 7] deltal-deltaO <=thetapsi ... (8) 

[0025] In an actual case, thetay and thetac can be set about brightness and a chrominance. 

respectively. 

[Table 1] 
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[0026] Table 1 shows the message for encoding the macro edge about a primary component As 
geometric information on a macro edge, the starting point of a macro edge, a direction, and the 
die length of a unit have the predetermined range and the number of bits, and are encoded 
Moreover, about local adjustment MENTO, the difference of a macro edge and an actual edge 
location is encoded. Moreover, in this example, the element of the both sides of brightness and a 
chrominance is encoded. Geometric information and geometric local adjustment MENTO are 
obtained using a luminance element, and reinforcement other than another side and the flag 
showing the semantics of a chroma (color) is calculated for every color element 
[0027] Next, the image reconstruction section 16 is explained. The primary component 14 
contains onfy the reinforcement of edge associated data, i.e., geometric information, and each 
macro edge. So, a certain kind of interpolation/extrapolation must be used in order to predict the 
gray level in fields other than an edge belt Reconstructive processing draws the pixel in each 
edge belt using (i) geometry information, local adjustment MENTO, and reinforcement (namely, 
contrast). About local adjustment MENTO, interpolation of the actual edge location between 
adjoining sampling points is carried out in linearity. In this way, each pixel in an edge belt can give 
a gray level depending on the side in which an actual edge is located. 

(ii) The reference pixel of eight directions is used for interpolation, omegai which predicts the 
gray level on pixel criteria, and alphai are made into distance from the pixel predicted to be a 
reference pixel, and phi on Direction i shows each (refer to drawing 8 ). Other reference pixels do 
not exist between phi and omega i. omegai is made into the gray level in reference pixel omegai, 
and the gray level of the pixel which is shown by phi and which is predicted is called for from a 
bottom type. 
[Equation 8] 
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[0028] Such processing is performed until It results far away from a near edge belt, in order to 
obtain the smooth change by the gray level. The segmentation in an adjustable size block is 
performed to the whole image, and interpolation is performed from a small block to a big block. 
[0029] Next, the differential-encoding section is explained. Although the primary image 18 
reproduced by the image reconstruction section 1 6 is lacked in the detail of a smooth field, i.e., 
the loose field of a change on the strength, it offers the depiction which was excellent in 
consciousness. In order to fill up the detail in this field, the so-called adjustable block-size 
coding processing on the basis of the edge orientation sensibility of human being's vision system 
is used. That is, coding by the small block size is performed in the neighborhood of an edge, and 
coding by another side and the big block size is used when the distance from an edge increases. 
The combination of a block size 8*8. 16*16, and 32*32 is applied in order to attain high-pressure 
shrinking percentage. In this way. the quality image defined as the second image with the 
SUKERA kinky thread tee of SNR can be obtained 

[0030] This technique is coding characterized by nonlinear sampling using edge information, and 
shows the outline of the processing to drawing 9 . it mentioned above — as ( drawing 1 ) — the 
difference of the subject-copy image 200 and primary component images 18 — a value — 
difference — it asks with a vessel 20 — having — this difference — a value is supplied to the 
nonlinear sampling section 202. Nonlinear sampling to which a block size is changed according to 
the local property of an image is called the adaptation block encoding method, and the various 
implementation technique is proposed. Those most are transmitting additionally the information 
which shows a block size, and the information which shows division of a block. In order that this 
technique may utilize the information on the edge (after local adjustment MENTO application) 
which is the coded data of a primary component and may realize nonlinear sampling, it does not 
need additional information. In this example, a square block (the block of three kinds of 
magnitude, i.e., 32-pixel S*32 base, 16 pixels * 16 pixels, and 8 pixels * 8 pixels) is used. First, an 
edge is developed on the bit plane of the same magnitude as an image, and a flag is set in the 
location where the element of an edge exists. Next, a 32-pixel block [ -32 pixel ] performs 
linearity sampling. And if the flag stands in the block concerned about each block, it divides into 
four 1 6 pixel x 1 6-pixel blocks and the flag does not stand, suppose that it remains as it is. 
Similarly, in the next phase, if the flag stands in the block concerned about the 16 pixel x 16- 
pixel block it divides into four 8 pixel x 8-pixel blocks and the flag does not stand, suppose that 
it remains as it is. Thus, improvement in vision evaluation is expectable by changing a block size 
depending on the distance from an edge. 

[0031] Processing after nonlinear sampling is performed one by one by the discrete cosine 
transform section 204 and multiplier quantization which are generally performed and the capable 
block judging section 206, the multiplier scan section 208, and the run level coding section 210. It 
is fundamentally [ as MPEG-1 (Moving Pictures Expert Group Phase-1:ISO/IEC -11172) which is 
JPEG (Joint Photographic Expert Group;ISO -10918) and the dynamic-image coding standard 
which are coding using a discrete cosine transform (DOT), for example, a color static^fmage 
coding standard, and MPEG-2 (Moving Pictures Expert Group Phase-2:ISO/IEC -13818)] the 
same. By the proposal technique, using three kinds (namely. 32 pixel x32 pixel, 16 pixel x16 pixel, 
and 8 pixels x 8 pixels) of discrete cosine transforms with nonlinear sampling is mentioned to 
using as difference the discrete cosine transform these criteria of whose are 8 pixel x8 pixels. 
[0032] Next, the result of the simulation of this example is shown below, the engine performance 
of above-mentioned this example — simulating — the intra of MPEG-2 — it compared with the 
engine performance of image (inside of frame) coding. Simulation conditions are K= 1.0, Lunrt=4 
pixel, Lext=7 pixel. thetay=0.10. thetac^O.OZ, and Lsub=4 pixel. 

[0033] As shown in drawing 10 , test sequence "Susie" whose pixel size is 704 pixels * 480 lines 
is used. A color format is 4:2:0 and is 8 bits/pixel. The result of macro edge detection and local 
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adjustment MENTO is shown in drawing 1 1 and drawing 1 2 , respectively, a playback image, i.e., a 
primary image, and the second image — respectively — drawing 13 and 15 — being shown — 
them and HPEG- SNR to which an image corresponds 2 intra is shown in Table Z 
[Table 2] 
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The segmentation in the adjustable size block used for the both sides of interpolation processing 
and differential encoding is shown in drawing 14 . In this example, 255 macro edges extracted 
from the subject-copy image exist. In addition, as for this drawing (a), the 2nd-step division 
image and this drawing (c) show the last division image, as for an initial division image and this 
drawing (b). 

[0034] The hierarchical edge detection by this example gives the compact expression of edge 
information, and. so, a primary image gives the rough outline of a body as shown in drawing 1 3 , 
or a scene. Although the compressibility about a primary component was 250:1 or more, image 
quality was not suitable in itself Addition of a smooth component attains 70:1 or more 
compressibility, and raises image quality considerably. From the above-mentioned simulation 
result the picture compression encoding method by this example is a low bit rate, is SNR which 
is equal to image coding in MPEG-two frames (intra), and offers high definition more. 
[0035] This invention has the description based on the encoding method using the hierarchical 
edge detection equipped with differential encoding. This approach is accomplished corresponding 
to the need about the latest low bit rate / high-pressure shrinking percentage image encoding 
method. The model used in the example of this invention disassembles an image into the primary 
component containing an edge element, and the smooth component in which a change on the 
strength carried out slowly is shown fundamentally. The effectiveness of this invention which let 
pass with simulation and was obtained is as follows. 

[0036] MPEG- which mentioned [ 1st ] the technique of this example above — - the engine 
performance of image coding (I-picture) is improved 2 intra, and MSE based on the precision of 
another side and a body can match. What mainly contributes to the 2nd at such engine- 
performance amelioration is the effective sensuous tuning [ express and ] on the basis of the 
direction and differential encoding, i.e., adjustable block-size coding, of edge information which 
used hierarchical edge detection. Furthermore, this example enables the gradual transfer to a 
secondary image from a primary image, it is desirable to application like browsing in an image 
database etc., and most of another side and second generation coding techniques do not give 
this description. 
[0037] 

[Effect of the Invention] According to the image processing system concerning this invention, 
coding processing of the image data which could offer the method of encoding edge contrast 
directivity, and was excellent in consideration of the moral vision property of human being's 
vision system can be performed by having used hierarchy edge detection (the unit edge 
detection shown in an example, macro edge detection, and step of local adjustment MENTO). 
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PRIOR ART 



[Description of the Prior Art] In order that International Organization for Standardization (ISO) 
might answer the need for the general approach of encoding an animation by the low bit rate and 
might build the video coding standard about various applications, such as a video telephone and 
mobile communications, rt formed MPEO-4 (Moving Pictures Expert Group, Phase 4) in 1993. 
The main purposes of many picture compression encoding methods tend to perform high 
playback of the fidelity about a subject-copy image with high-pressure shrinking percentage as 
much as possible. The criteria of fidelity of being used for the design of the compression 
encoding method play a big role on the engine performance. The criteria of fidelity of generally 
being used are an average square error (MSE). The main special features of MSE are that the 
mathematical count is easy and that the small value of MSE actually corresponds to the 
playback image of high quality sensuously. Since a final judgment of the reproduced image is 
made by human being's eyes, the latter is important 

[0002] The various image coding techniques of having MSE as criteria of fidelity, such as 
conversion coding, have been developed Although these techniques bring about a comparatively 
quality playback image by the bit rate beyond a pixel, 1.0 bits /. and ft they are one of these and 
produce often more special visible degradation, for example, block distortion, edge dotage, etc. in 
a low bit rate. The new class of the image encoding method well learned as a second generation 
coding technique has been developed over the past ten years or more. These approaches tend 
to prove upgrading of the technique of MSE orientation [ bit rate / low-speed ] very much, and 
tend to draw an image by expressing a true stereo like a border line or texture in a compact 
further. So, the second generation encoding method is expected to attain high-pressure 
shrinking percentage on the criteria of the fidelity to which human being's eye which is not yet 
realized pointed. 

[0003] Image coding based on sketch drawing is considered as a typical means of this category, 
and has been quoted as reference. This approach characterizes according to a profile line- 
extraction process, and results in bringing about a harmful distortion in sketch drawing playback 
to a local noise, by detection of a pixel unit since it is brittle. 
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EFFECT OF THE INVENTION 



[Effect of the Invention] According to the image processing system concerning this invention, 
coding processing of the image data which could offer the method of encoding edge contrast 
directivity, and was excellent in consideration of the moral vision property of human being's 
vision system can be performed by having used hierarchy edge detection (the unit edge 
detection shown in an example, macro edge detection, and step of local adjustment MENTO). 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] Moreover, a subject-copy image is conventionally 
disassembled into two components in addition to above-mentioned technique, and the technique 
of encoding those components is known* This technique disassembles a subject-copy image into 
a primary component (primary component) including edge information, and the loose smooth 
component (secondary component) of brightness change. The idea of decomposition coding was 
produced from 2 component model by John (Yan) and SAKURISON (Sakrison). and some 
practical approaches have been studied since then. 

[0005] All the approaches by th ese decomposition coding have the impact for the image quality 
of a playback image, as a result the whole engine performance with this big focusing on an edge 
extract i.e., detection, an expression, and coding. Chain coding is used for a great portion of 
technique, in order to perform edge detection of a pixel unit like a peak point trace, i.e., an edge 
trace, and to encode the sequence of an edge location. However, it is pointed out that the 
problem of a closed curve and dealing with a local noise are difficult, and, as for the above- 
mentioned technique, cause the result of interruption of an edge, a location error, and inaccurate 
reinforcement Moreover, since it was thought that the information on a context exists only in 
the field restricted very much, there was no method of distinguishing the border line 
corresponding to an objective boundary and the border line which is not so. 
[0006] The purpose of this invention solves the technical problem of the above-mentioned 
conventional technique, and offers the image processing system which can acquire edge 
positional information from image data, and its approach by hierarchical edge detection. Other 
purposes of this invention offer the image of high quality while they introduce each step of 
hierarchical edge detection, i.e., unit edge detection, macro edge detection, and local acljustment 
MENTO and express edge information in a compact 

[0007] Other purposes of this invention offer the image processing system which fidelity is 
excellent in in coding of image data, and encodes the image data based on high-pressure 
shrinking percentage, and its approach. Other purposes of this invention decompose image data 
into primary image components and secondary image components, and offer the image 
processing system which can reproduce the primary image by which edge orientation was carried 
out from primary image components, and its approach. 
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MEANS 



[Means for Solving the Problem] It has the following means, In order to solve the above- 
mentioned technical problem. While the image processing system concerning invention of the 1st 
of this application detects the binary image in which the edge location which is the boundary of 
reception and this image data to a pixel value change about the image data of two-dimensional 
size is shown The 1st [ which corresponds the 1st edge positional information which shows the 
direction component of said edge location from this binary image ] detection means which 
detects for every pixel, The 2nd detection means which detects the 2nd edge positional 
information which reception and a direction component carry out grouping of said 1 st edge 
positional information relevant to mutual for said 1st edge positional information, and shows the 
edge location by which grouping was carried out, A means to ask for the transition location of a 
pixel value by referring to each pixel value in said image data area corresponding to reception 
and said 2nd edge positional information for said 2nd edge positional information, It has a coding 
means to encode the difference of the edge location specified to said 2nd edge positional 
information and said 2nd edge positional information, and said transition location. 
[0009] Moreover, a detection means to detect the edge positional information the image 
processing system concerning the 2nd invention indicates the edge location which is the 
boundary of reception and this image data to a pixel value about the image data of two- 
dimensional size to be, A coding means to encode said edge positional information, and an image 
reconstruction means to perform image reconstruction based on the encoded edge positional 
information, the difference of said image data and the playback image data reproduced by said 
playback means — a means to encode a value, the image based on edge positional information, 
and difference — it has the means and ** which raise image quality gradually by carrying out 
sequential transmission of the value. Since the application by this invention is a thing relevant to 
MPEG-4 area, the video telephone which deals with several sorts of bodies, and its pocket 
communication link are desirable as target application. The test sequence of a bust is used for 
simulation by such intention. 



[Translation done.] 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated 
3.1n the drawings, any words are not translated. 

OPERATION 



[Function] According to this invention, by having used hierarchical edge detection (the unit edge 
detection shown in an example; macro edge detection, and step of local adjustment MENTO). the 
coding technique of edge contrast directivity can be offered and coding processing of the 
outstanding image data can be performed in consideration of the moral vision property of human 
being's vision system. 
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EXAMPLE 



[Example] Hereafter, the example of the image processing system of this invention is explained 
to a detail with reference to a drawing. Drawing 1 is the block diagram showing the configuration 
of decomposition coding concerning the image processing system of this example. As shown in 
this drawing, a subject-copy image is supplied to the edge extract section 10, and the edge 
information about the border line of the body in an image etc. is extracted here. The extracted 
edge information is supplied to the data optimization section 12, and in order to attain high- 
pressure shrinkage, edge information-redundancy nature is removed. In this way. the primary 
component (primary component) 14 about the edge information extracted from the subject-copy 
image is obtained. 

[0012] Moreover, the primary component 14 is supplied to the image reconstruction section 16, 
and the primary image 18 is reproduced based on a primary component and the reproduced 
primary image 18 — difference — a subject-copy image and difference ask in a vessel 20 — 
having — this difference — a value is supplied to the differential-encoding section 22. here — 
difference — DCT processing by the adjustable size block is performed about a value, and the 
encoded smooth component (secondary component) 24 is obtained. Drawing 2 is drawing 
showing the hierarchization edge extract process in the edge extract section of drawing 1 . The 
process of the edge extract from a subject-copy image is performed through each of the 
Laplacian filter 100, the unit edge detecting element 102, the macro edge detecting element 104, 
the local adjustment MENTO section 106. and the on-the-strength count section 108. 
[0013] First, as a subject-copy image, the image data (brightness component) of 480*704-pixel 
size is supplied to the Laplacian filter 100, and well-known Laplacian processing is performed. 
That is, secondary differential data in which the change about each pixel is shown are called for. 
In addition, the image data of a color difference component is the size sampled by one half in 
480*704. and these data are used in the on-the-strength count section 1 08 mentioned later- 
Next the data by which Laplacian processing was carried out are supplied to the unit edge 
detecting element 102, and the binary image in which an exact edge location is shown is obtained 
by using mu+K-sigma for a threshold. Here, mu, sigma, and K are an average, the standard 
deviation of derivative space, and a multiplier, respectively. The concept of an edge location is 
used as a thing showing the boundary of the change, when the brightness of each pixel in image 
data changes steeply and continuously. 

[0014] And it matches about the pixel which shows the edge location in a subject-copy image 
using the segment pattern in which eight directions as shown in drawing 3 are shown. The 
pattern for matching is shown by Template Tn (n= 0. 1, 7), and each entry in (j. k) is expressed 
by tn (j» k). the sub field which consists lambda (x y) of 5*5pixellambda (x+j, y+k) — It is — 
making Or k= 0, 1, 2, 3. 4) . The cross-correlation CRn (x y) between Tn and lambda (x y) is 
calculated by the degree type. 
[Equation 1] 

CRn (x. y) = X zln (J, k) *A (x+ J, y + k) -U) 

[001 5] Therefore, CRn (x y) is equal to 7, or if n which is seven or more exists, a flag will stand 



on the coordinate (x y) of n bit plane. This shows that it was chosen as a matching pattern which 
Template Tn Is a coordinate (x y) and calls a unit edge. For example, in matching about the pixel 
which shows a certain edge location, the pixel concerned used as a processing object is located 
at the core (location of three-line three trains) of a template, and if the neighboring pixel of the 
pixel concerned is located horizontally, template T four will be chosen, and the edge location 
which is the pixel concerned is processed as a thing with the direction component of T four. In 
addition, among drawing, the numeric value of "1" and "2" shows weighting of matching, and "2" 
is processing it as a thing heavier than "1" by thisexample. 

[0016] Next, grouping, i.e., macro-izing, is performed by the macro edge detecting element 104 
about the pixel by which the unit edge was detected. As mentioned above, although a unit edge 
is prescribed by the template of eight directions, It is connected to the macro edge on which 
each of these unit edges are specified in the 1 6 directions in a continuous phase. 
[001 7] If the pixel concerned which should be processed shall be located in one line, five trains, 
and (1. 5) supposing the pixel matrix of five line *9 train, the direction of 16 specified on a macro 
edge the location of (5, 5) of right under [ the ] — direction "0" — carrying out — and order — 
(5, 4), and ... (5 3) (5 1) — respectively — a direction — "1~ and "2 "and" 4" — carrying out — 
moreover, order — (4. 1), (3, 1). and (2, 1) — respectively — a direction — it is referred to as "5 
"and" 7." the same — the order from direction "0" — right-hand side — (5, 6), and ... (5 7) (5 9) 
— respectively — a direction — "15" and "14 "and' 12" — carrying out — moreover, order — 
(4, 9\ (3,^9), (2 f 9), end (1.9) — respectively — a direction — it is referred to as "1 1" and "10 
"and" 8." The direction n of a unit edge corresponds to N specified at a ceremony (2), and N is 
the core of the direction of a base that search processing for connection is performed. 
[Equation 2] N= 2n ... (2) 

[0018] The direction of the connection in a macro edge must be detected out of the direction of 
three candidates, i.e., N, N-1, and N+1. For example, if a certain unit edge is a template T1 t the 
unit edge which is N= 2, therefore should be connected firom the direction of 1, 2, and 3 will be 
detected. A unit edge must be connected in the direction which can extract a macro edge with 
the longest criteria of selection. In the direction of each candidate, it is determined in each node 
segmented by the unit length Lunit (4 pixels is said) whether a macro edge is connected, if the 
flag of the bit side n, n-1, and n+1 arises near a node, a macro edge will be extended till a node. 
It is dependent on what is carried out what magnitude of a field counts for such decision. In 
addition, the unit edge of the pixel which will be located on the macro edge is eliminated after 
connection processing termination of a macro edge. 

[0019] Here, with reference to drawing 4 and drawing 5 , the concrete example of macro edge 
detection is explained. A macro edge is detected by connecting a unit edge in the following 
procedures. First, the unit edge developed on n-bit plane is considered to be seemingly 
developed by N-bit plane so that it may correspond to (2) types. Supposing the flag stands on 
N-bit plane now, it will consider as the starting point lambda of the macro edge which detects 
the location after this. It is node piN and L about the point searched in case L unit edges are 
connected in the direction N from the starting point lambda. A definition is given and it is lambda 
in Lunit=4, piN, and L Physical relationship is shown in drawing 4 . At this example, it is piN and 
L about a search aperture. It will consider as the 3x3-pixel field made into a core, and if the flag 
stands on this field on N. N-1, and an N+1 -bit plane, sequential increment of the number L of 
connection is carried out, a search will be repeated and the node of the last whose connection 
was completed will be made into the terminal point of the candidate macro edge of Direction N. 
The candidate macro edge of a direction N-1 and a direction N+1 is also detected from the same 
starting point (if the flag stands into the search aperture on N-2 or N-bit plane by the search of 
a direction N-1 in these cases, it will be judged as connection), and, finally the number L of 
connection detects the greatest thing as a macro edge in these 3 candidate. Supposing two or 
more candidates with the maximum number L of connection exist this number will choose the 
larger one. using the total of the flag in a search aperture as secondary scale. Next, the example 
of connection of a unit edge is shown in drawing 5 . The minimum field divided by the ruled line is 
a pixel, and each block diagram expresses the same subregion on en image. Let the first location 
scans N bit plane and the flag stands be the starting point lambda of a macro edge. In this 



example, lambda is called for on 2-bit plane. Therefore, the search for connection will search a 
direction 3 by the search of a direction 1, and 2-bit plane by 0-bit plane at the search of 
directions 1. 2, and 3. and 4-bit plane. piN In case the number L of connection becomes max in 
the search of directions 1, 2, and 3, respectively, and L A location is shown in the lower berth of 
drawing 5 . Finally at this example, it is pi 1 and 3. It becomes the terminal point of the macro 
edge to detect. 

[0020] In this way. detection of the macro edge about each unit edge is performed, and the 
starting position of the macro edge by which grouping was carried out the direction of either of 
16, and die length are obtained Next in the local adjustment MENTO section 106, the rectangle 
field which wraps a macro edge in predetermined die-length Lext (this example 7 pixels) is 
specified as an edge belt E using the callecHbr macro edge. Drawing 6 is the example of a belt 
edge and sets a shaft perpendicular to a shaft parallel to a macro edge to p and q, respectively. 
And the pixel value on the edge belt E Is expressed as epsilon (x y). 

[0021] Generally, an actual edge can be assumed to be what exists along with the macro edge of 
the edge belt E. In order to locate an actual edge correctly, change (8-bit gradation) of the gray 
level of a pixel is inspected in accordance with the shaft q perpendicular to a macro edge. The 
step is explained. 

0) The average phi of the gray level of all the pixels in an edge belt is calculated first 

(ii) If it is smaller than the average psi, 0 is marked on the pixel corresponding to epsilon (x y), 
and if the gray level of each pixel is larger than the average psi. It will mark 1 about each pixel of 
the edge belt E. 

(iii) An actual edge is located to the place which the transition to 0 to 1, or 1-0 produces 
(default"0" which expresses the pixel which does not produce such transition about the shaft on 
a macro edge is used). 

(iv) By calculating respectively the average value about the pixel marked by the both sides of 0 
and 1, the edge profile which has an ideal step function is approximated, and it is the 
reinforcement delta 0 of the lower one. Reinforcement delta 1 of the higher one It obtains, 
respectively. 

[Equation 3] 

*o = Z s * (P. Q) -0) 

r 0 (IX q) <* 

*i =— — 2 Z £ (P, q) -<4) 

[0022] Here, it is tau 0. tau 1 The number of pixels with which are satisfied of the monograph 
affair of a sum total type (3) and (4) is shown. D rawing 7 shows the example of tic [ SUKEMA ] 
acquired by the local adjustment MENTO section 106. An actual edge location is pursued by the 
thick wire. Moreover, the sequence of the pixel of a shaft q = 0 corresponds to a macro edge. In 
addition, the on-the-strength count section 108 performs count of the above-mentioned sum 
total type (3) and (4) based on the result of the local adjustment MENTO section 106. Moreover, 
the on-the-strength count section 108 performs count on the strength with the same said of a 
color difference component 

[0023] The edge data obtained according to the above process are outputted to the data 
optimization section 12 from the edge extract section 10 shown in drawing 1 . In order to attain 
high-pressure shrinking percentage, the data optimization section 1 2 is removed from the edge 
data from which redundancy and the information which is not not much important were 
extracted, and encodes edge data. 

0) Since the actual edge obtained by the local adjustment MENTOROKARUAJASUTOMENTO 
section 106 has the low pass property which met in the direction of a macro edge as shown in 
above-mentioned drawing 7 , by carrying out subsampling in the predetermined period Lsub, it 
reduces data and performs differential encoding about the reduced data. 

(ii) — reinforcement and Weber FEFUNA — with reference to a brightness difference threshold. 
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this removes the edge which is not not much important in human being's vision sensibility using 
law. Let deltal be the brightness difference threshold of an illuminance I. deltal is prescribed that 
brightness becomes remarkable, when a brightness difference reaches deltal or it is exceeded 
[Equation 4] 
A I 

— — =0 ..< 5 ) 

[0024] The above-mentioned formula can be expressed with a multiplier zeta, being able to 
assume that it is what deltal/I gives the magnitude of the vision sensibility E well. 
[Equation 5] 
A I 

ae=c — ..<$> 
I 

It integrates with this and is [Equation 6]. E=zeta'logl ... (7) 

In order to apply the Weber FERJNA method to the encoding method, a formula (5) is 
transformed using an original definition. That is, the macro edge with which are satisfied of a 
bottom type is removed from the data of a primary component 
[Equation 7] delta 1-defta0 <=thetapsi ... (8) 

[0025] In an actual case, thetay and thetac can be set about brightness and a chrominance, 

respectively. 

[Table 1] 
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[0026] Table 1 shows the message for encoding the macro edge about a primary component As 
geometric information on a macro edge, the starting point of a macro edge, a direction, and the 
die length of a unit have the predetermined range and the number of bits, and are encoded. 
Moreover, about local adjustment MENTO. the difference of a macro edge and an actual edge 
location is encoded. Moreover, in this example, the element of the both sides of brightness and a 
chrominance is encoded. Geometric information and geometric local adjustment MENTO are 
obtained using a luminance element and reinforcement other than another side and the flag 
showing the semantics of a chroma (color) is calculated for every color element 
[0027] Next, the image reconstruction section 16 is explained. The primary component 14 
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contains only the reinforcement of edge associated data, i.e.. geometric information, and each 
macro edge. So, a certain kind of interpolation/extrapolation must be used in order to predict the 
gray level in fields other than an edge belt Reconstructive processing draws the pixel in each 
edge belt using (I) geometry information, local adjustment MENTO, and reinforcement (namely, 
contrast). About local adjustment MENTO, interpolation of the actual edge location between 
adjoining sampling points is carried out in linearity. In this way, each pixel in an edge belt can give 
a gray level depending on the side in which an actual edge is located. 

GO The reference pixel of eight directions is used for interpolation, omegai which predicts the 
gray level on pixel criteria, and alphai are made into distance from the pixel predicted to be a 
reference pixel, and phi on Direction i shows each (refer to drawing 8 X Other reference pixels do 
not exist between phi and omega i. omegai is made into the gray level in reference pixel omegai, 
and the gray level of the pixel which is shown by phi and which is predicted is called for from a 
bottom type. 

[Equation 8] 

^ J 7 _ 

0 = — 52o>i a I -<9) 

[0028] Such processing is performed until it results far away from a near edge belt, in order to 
obtain the smooth change by the gray level. The segmentation in an acflustable size block is 
performed to the whole image, and interpolation is performed from a small block to a big block. 
[0029] Next, the differential-encoding section is explained Although the primary image 18 
reproduced by the image reconstruction section 1 6 is lacked in the detail of a smooth field, i.e., 
the loose field of a change on the strength, it offers the depiction which was excellent in 
consciousness. In order to fill up the detail in this field, the so-called adjustable block-size 
coding processing on the basis of the edge orientation sensibility of human being's vision system 
is used. That is, coding by the small block size is performed in the neighborhood of an edge, and 
coding by another side and the big block size is used when the distance from an edge increases. 
The combination of a block size 8*8, 16*16, and 32*32 is applied in order to attain high-pressure 
shrinking percentage. In this way. the quality image defined as the second image with the 
SUKERA kinky thread tee of SNR can be obtained. 

[0030] This technique is coding characterized by nonlinear sampling using edge information, and 
shows the outline of the processing to drawing 9 . it mentioned above ■ — as ( drawing; 1 ) — the 
difference of the subject-copy image 200 and primary component images 18' — a value — 
difference — it asks with a vessel 20 — having — this difference — a value is supplied to the 
nonlinear sampling section 202. Nonlinear sampling to which a block size is changed according to 
the local property of an image is called the adaptation block encoding method, and the various 
implementation technique is proposed Those most are transmitting additionally the information 
which shows a block size, and the information which shows division of a block. In order that this 
technique may utilize the information on the edge (after local acUustment MENTO application) 
which is the coded data of a primary component and may realize nonlinear sampling, it does not 
need additional information. In this example, a square block (the block of three kinds of 
magnitude, i.e., 32-pixel S*32 base. 16 pixels * 16 pixels, and 8 pixels * 8 pixels) is used. First, an 
edge is developed on the bit plane of the same magnitude as an image, and a flag is set in the 
location where the element of an edge exists. Next, a 32-pixel block [ -32 pixel ] performs 
linearity sampling. And if the flag stands in the block concerned about each block, it divides into 
four 16 pixel x 16-pixel blocks and the flag does not stand, suppose that it remains as it is. 
Similarly, in the next phase, if the flag stands in the block concerned about the 16 pixel x 16- 
pixel block, it divides into four 8 pixel x 8-pixel blocks and the flag does not stand, suppose that 
it remains as it is. Thus, improvement in vision evaluation is expectable by changing a block size 
depending on the distance from an edge. 

[0031] Processing after nonlinear sampling is performed one by one by the discrete cosine 
transform section 204 and multiplier quantization which are generally performed and the capable 



block judging section 206, the multiplier scan section 208, and the run level coding section 210 It 
'f D ™ damentally C SS MPEG " 1 (Moving Pictures Expert Group Phase- 1:IS0/1EC -1 1 172) which is 
JPEG (Joint Photographic Expert GroupjISO -10918) and the dynamic-Image coding standard 
which are coding using a discrete cosine transform (DOT), for example, a color statio-image 
coding standard, and MPEG-2 (Moving Pictures Expert Group Phase-2:ISO/IEC -13818) ] the 
same. By the proposal technique, using three kinds (namely. 32 pixel x32 pixel, 16 pixel x16 pixel, 
and 8 pixels x 8 pixels) of discrete cosine transforms with nonlinear sampling is mentioned to 
using as difference the discrete cosine transform these criteria of whose are 8 pixel x8 pixels. 
[0032] Next, the result of the simulation of this example is shown below, the engine performance 
of above-mentioned this example — simulating — the Intra of MPEG-2 — it compared with the 
engine performance of image (inside of frame) coding. Simulation conditions are K= 1.0, Lunit=4 
pixel, Lext=7 pixel, thetay=0.10. thetac=0.02, and Lsub=4 pixel. 

[0033] As shown in drawing 10 , test sequence "Susie" whose pixel size is 704 pixels * 480 lines 
is used. A color format is 4:2:0 and is 8 bits/pixel. The result of macro edge detection and local 
adjustment MENTO is shown in drawing 1 1 and drawing 1 2 , respectively, a playback image, i.e.. a 
primary image, and the second image — respectively — drawing 1 3 and 15 — being shown — 
them and HPEG- SNR to which an image corresponds 2 intra is shown in Table 2 
[Table 2] 
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The segmentation in the adjustable size block used for the both sides of interpolation processing 
and differential encoding is shown in drawing 14 . In this example, 255 macro edges extracted 
from the subject-copy image exist In addition, as for this drawing (a), the 2nd~step division 
image and this drawing (c) show the last division image, as for an initial division image and this 
drawing (b). 

[0034] The hierarchical edge detection by this example gives the compact expression of edge 
information, and, so, a primary image gives the rough outline of a body as shown in drawing 13 , 
or a scene. Although the compressibility about a primary component was 250:1 or more, image 
quality was not suitable in itself. Addition of a smooth component attains 70:1 or more 
compressibility, and raises image quality considerably. From the above-mentioned simulation 
result the picture compression encoding method by this example is a low bit rate, is SNR which 
is equal to image coding in MPEG-two frames (intra), and offers high definition more. 
[0035] This invention has the description based on the encoding method using the hierarchical 
edge detection equipped with differential encoding. This approach is accomplished corresponding 
to the need about the latest low bit rate / high-pressure shrinking percentage image encoding 
method. The model used in the example of this invention disassembles an image into the primary 
component containing an edge element and the smooth component in which a change on the 
strength carried out slowly is shown fundamentally. The effectiveness of this invention which let 
pass with simulation and was obtained is as follows. 

[0036] MPEG- which mentioned [ 1st ] the technique of this example above — the engine 
performance of image coding depicture) is improved 2 intra, and MSE based on the precision of 
another side and a body can match. What mainry contributes to the 2nd at such engine- 
performance amelioration is the effective sensuous tuning [ express and ] on the basis of the 



direction and differential encoding, i.e. f adjustable block-size coding, of edge information which 
used hierarchical edge detection. Furthermore, this example enables the gradual transfer to a 
secondary image from a primary image, it is desirable to application like browsing in an image 
database etc., and most of another side and second generation coding techniques do not give 
this description. 



* NOTICES * 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated 



' ' ' «— « I ■ M 



DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 
[Drawing 1] The block diagram showing the configuration of decomposition coding concerning the 
image processing system of this example. 

[Drawing 21 Drawing showing the hierarchization edge extract process in the edge extract 
section of drawing . 

[Drawing 31 Drawing showing the segment pattern of eight directions. 

[Drawing 41 Drawing showing the physical relationship of lambda and pi in macro edge detection. 
[Drawing 5] Drawing showing the example of connection of the unit edge in macro edge 
detection. 

[Drawing 6] Drawing showing the concept of an edge belt. 

[Drawing 71 Drawing showing the example of local adjustment MENTO, 

[Drawing 8] Drawing showing the relation of phi and omegai in playback of a primary image. 

[Drawing 9] Drawing showing the step of the adjustable block-size encoding method 

[Drawing 10] Drawing showing test sequence "Susie". 

[Drawing 11] Drawing showing the result of macro edge detection. 

[Drawing 1 2] Drawing showing the result of local adjustment MENTO. 

[Drawing 131 Drawing showing a primary image. 

[Drawing 141 Drawing showing the segmentation in an adjustable size block 

[Drawing 15] Drawing showing a secondary image. 

[Description of Notations] 

1 0 Edge Extract Section 

1 2 Data Optimization Section 

14 Primary Component 

1 6 Image Reconstruction Section 

1 8 Primary Image 

20 Difference — Vessel 

22 Differential-Encoding Section 

24 Smooth Component 

100 Laplacian Filter 

102 Unit Edge Detecting Element 

104 Macro Edge Detecting Element 

1 06 Local Adjustment MENTO Section 

108 On-the-Strength Count Section 
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